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[Title of the Invention] BINOCULAR IMAGE SENSING 

APPARATUS 

[Abstract] 

[Object] An object of this invention is to provide a 
5 binocular image sensing apparatus capable of capturing 
an image in accordance with each person in recording, 
reducing the process load in playback, and implementing 
high-quality stereopsis. 

[Structure] A mode switch (2) designates display of 

10 viewpoint centers, and gazing point position processing 
units (17R, 17L) display the viewpoint centers on 
viewfinders (15R, 15L) . An observer observes the 
viewpoint centers displayed on the viewfinders with his 
two eyes through line-of -sight detection units (16R, 

15 16L) . The line-of -sight detection units detect the 

visual axis angles of the two eyes of the observer. A 
motor (22) adjusts the interval between the line-of - 
sight detection units until the visual axis angles of 
the two eyes that are detected by the line-of -sight 

20 detection units become smaller than a threshold. Upon 
completion of adjusting the interval, the mode switch 
(2) designates display of a stereoscopic image, and the 
viewfinders display right and left images which form 
the stereoscopic image. The observer can appropriately 

25 observe the stereoscopic image adjusted to his two 
eyes . 
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[What Is Claimed Is:] 

[Claim 1] A binocular image sensing apparatus 
comprising : 

a first line-of -sight detection unit and second 
5 line-of -sight detection unit which are arranged in 
correspondence with two eyes of an observer, have an 
adjustable interval, and detect visual axis angles of 
the two eyes of the observer; 

a first viewfinder and second viewfinder which 
10 are respectively integrated with said first line-of - 
sight detection unit and said second line-of -sight 
detection unit, and allow the observer to independently 
observe the first viewfinder and the second viewfinder 
with the two eyes of the observer through said first 
15 line-of -sight detection unit and said second line-of - 
sight detection unit; 

an image display unit capable of selectively 
displaying viewpoint centers or stereoscopic images on 
said first viewfinder and said second viewfinder; 
20 a display instruction unit which instructs said 

image display unit to selectively display the viewpoint 
centers or the stereoscopic images on said first 
viewfinder and said second viewfinder; and 

an adjustment unit which, when said image display 
25 unit displays the viewpoint centers on said first 

viewfinder and said second viewfinder in accordance 
with an instruction from said display instruction unit, 
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adjusts the interval between said first line-of -sight 
detection unit and said second line-of -sight detection 
unit until the visual axis angles of the two eyes that 
are detected by said first line-of -sight detection unit 
5 and said second line-of -sight detection unit become 
smaller than a threshold. 

[Claim 2] The binocular image sensing apparatus 
according to claim 1, wherein said adjustment unit can 
manually adjust the baseline length. 

10 [Claim 3] The binocular image sensing apparatus 

according to claim 1, wherein said image display unit 
displays images recorded by a first image sensing unit 
and a second image sensing unit, or images played back 
by a first image playback unit and a second image 

15 playback unit, on said first viewfinder and said second 
viewfinder in accordance with an instruction from said 
display instruction unit. 

[Claim 4] The binocular image sensing apparatus 
according to claim 2, wherein said image display unit 

2 0 displays images recorded by a first image sensing unit 
and a second image sensing unit, or images played back 
by a first image playback unit and a second image 
playback unit, on said first viewfinder and said second 
viewfinder in accordance with an instruction from said 

25 display instruction unit. 

[Claim 5] The binocular image sensing apparatus 
according to claim 1 or 3 , wherein said adjustment unit 
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stores, in a memory, data of the baseline length which 
is detected in advance and matches each observer, reads 
out data of the baseline length associated with a 
designated observer from the memory in accordance with 
5 designation of the observer, and automatically adjusts 
the interval between said first line-of -sight detection 
unit and said second line-of -sight detection unit by 
driving a motor so as to match the readout data. 

[Claim 6] The binocular image sensing apparatus 

10 according to claim 2, wherein when the baseline length 
is adjusted until the visual axis angles of the two 
eyes of the observer that are detected by said first 
line-of -sight detection unit and said second line-of - 
sight detection unit become smaller than the threshold, 

15 said image display unit displays, on said first 

viewfinder and said second viewfinder, a message that 
the baseline length is adjusted. 

[Claim 7] The binocular image sensing apparatus 
according to claim 3 or 4, wherein when a remaining 

2 0 amount of a battery for driving each unit decreases, 
convergence angle control and baseline length control 
stop . 

[Claim 8] The binocular image sensing apparatus 
according to claim 1 or 3 , further comprising mode 
25 selection means for a stereoscopic mode and a panoramic 
mode, 

wherein when the stereoscopic mode is selected, 
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said adjustment unit stores, in the memory, first data 
of the baseline length which is detected in advance and 
matches each observer, and second data of a baseline 
length of the panoramic mode, when the stereoscopic 
5 mode is selected, reads out first data associated with 
a designated observer from the memory in accordance 
with designation of the observer, and when the 
panoramic mode is selected, reads out the second data 
and automatically adjusts the interval between said 
10 first line-of -sight detection unit and said second 

line-of -sight detection unit by driving a motor so as 
to match the readout first data and the readout second 
data , 

[Claim 9] The binocular image sensing apparatus 
15 according to claim 3 or 4 , wherein two image sensing 
units are properly used among a plurality of image 
sensing units . 

[Claim 10] A binocular image sensing apparatus 
characterized by comprising: 
20 a plurality of image sensing units; 

a detection unit which detects an interval 
between two eyes of an observer; and 

an adjustment unit which adjusts an interval 
between said plurality of image sensing units in 
25 accordance with information from said detection unit. 

[Claim 11] The binocular image sensing apparatus 
according to claim 10, characterized in that said 



- 6 - 



JPA 7-23429 



detection unit comprises a first line-of -sight 
detection unit and second line-of -sight detection unit 
which detect visual axis angles of the two eyes of the 
observer . 

5 [Claim 12] The binocular image sensing apparatus 

according to claim 10, characterized by further 
comprising a plurality of viewfinders integrated with 
said plurality of image sensing units, 

wherein an interval between said plurality of 
10 viewfinders is adjusted in synchronism with adjustment 
of said image sensing units so as to substantially 
match the interval between the two eyes of the 
observer . 

[Detailed Description of the Invention] 
15 [0001] 

[Technical Field to Which the Invention 
Belongs] 

The present invention relates to a binocular 
image sensing apparatus using two image sensing means 

20 and, more particularly, to a binocular image sensing 
apparatus for inputting image sensing data for 
stereopsis using binocular parallax, or a binocular 
image sensing apparatus for inputting image sensing 
data to synthesize images obtained from respective 

25 image sensing units, and play back and display the 

synthesized images while changing the aspect ratio of 
the frame (performing aspect conversion) . 
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[0002] 

[Prior Art] 

Fig. 5 is a view showing the arrangement of a 
conventional binocular image sensing apparatus of this 
5 type. In Fig. 5, reference numeral 51 denotes a 

control unit which controls the whole operation; 52, a 
switch for switching between the recording mode and the 
adjustment mode; 53, a push button for starting 
adjustment; 54, a recording start/stop switch; and 60R 

10 and 60L, right and left image sensing units, 

respectively. Although not shown, the image sensing 
units 60R and 60L are equivalent to the image sensing 
unit of a movie camera or still camera having an image 
sensing lens, stop, shutter, image sensor, and the 

15 like. Reference numeral 71 denotes a storage unit for 
storing signals obtained by the image sensing units 60R 
and 60L on a magnetic tape, magnetic disk, or the like. 
[0003] 

If the binocular image sensing apparatus with the 
2 0 above arrangement records the images of a point P, the 
images obtained by the right and left image sensing 
units 60R and 60L have a binocular parallax at an angle 
6. In playback, a user sees these images with his 
right and left eyes to obtain stereoscopic vision. In 
25 this case, the angle d is called the convergence angle, 
and the interval L between the two image sensing units 
60R and 60L is called the baseline length. To obtain a 
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natural stereoscopic image, it is necessary to 
optimally set the convergence angle 8 and baseline 
length L. Conventionally, the baseline length is fixed 
and processed in playback, or manually adjusted to a 
5 proper interval . 
[0004] 

Japanese patent gazettes below disclose 
inventions related to this technique: Japanese Patent 
Laid-Open Nos . 1-93984, 1-93985, 64-86129, 62-266535, 
10 1-251990, and 60-119191. 
[0005] 

[Problems That the Invention Is to Solve] 
When the baseline length is fixed in recording, 
like the conventional binocular image sensing 

15 apparatus, the field interval between right and left 

images at the baseline length in recording is too wide 
(or too narrow) for a person to see a stereoscopic 
image (or to see a double image) in playback. To solve 
this problem, an image is processed in playback to 

20 pseudo-change the baseline length. However, it is 
difficult to measure and correct individual 
characteristics. The image process increases the 
process load in playback, and inhibits downsizing and 
cost reduction of the apparatus. It is cumbersome to 

25 manually adjust the baseline length, and it is 

difficult to adjust it under the same conditions. Even 
the same person does not provide the same adjustment 



- 9 - 



JPA 7-23429 



result . 
[0006] 

The present invention has been made to overcome 
the conventional drawbacks, and has as its object to 
5 provide a binocular image sensing apparatus capable of 
optimizing the baseline length for each person in 
recording to capture an image, reducing the process 
load in playback, and implementing high-quality 
stereopsis . 
10 [0007] 

[Means of Solving the Problems] 
A binocular image sensing apparatus according to 
the present invention comprises a first line-of -sight 
detection unit and second line-of -sight detection unit 

15 which are arranged in correspondence with two eyes of 
an observer, have an adjustable interval, and detect 
visual axis angles of the two eyes of the observer, a 
first viewfinder and second viewfinder which are 
respectively integrated with the first line-of -sight 

20 detection unit and the second line-of -sight detection 
unit, and allow the observer to independently observe 
the first viewfinder and the second viewfinder with the 
two eyes of the observer through the first line-of - 
sight detection unit and the second line-of -sight 

25 detection unit, an image display unit capable of 
selectively displaying viewpoint centers or 
stereoscopic images on the first viewfinder and the 
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second viewf inder , a display instruction unit which 
instructs the image display unit to selectively display 
the viewpoint centers or the stereoscopic images on the 
first viewf inder and the second viewf inder, and an 
5 adjustment unit which, when the image display unit 

displays the viewpoint centers on the first viewfinder 
and the second viewfinder in accordance with an 
instruction from the display instruction unit, adjusts 
the interval between the first line-of -sight detection 

10 unit and the second line-of -sight detection unit until 
the visual axis angles of the two eyes that are 
detected by the first line-of -sight detection unit and 
the second line-of -sight detection unit become smaller 
than a threshold. 

15 [0008] 

In this case, the adjustment unit may operate 
manually or automatically as far as whether the 
adjustment unit operates manually or automatically can 
be known or set when detecting a correct baseline 

20 length. The adjustment unit preferably stores, in a 
memory, data of the baseline length which is detected 
in advance and matches each observer, reads out data of 
the baseline length associated with a designated 
observer from the memory in accordance with designation 

25 of the observer, automatically adjusts the interval 

between the first line-of -sight detection unit and the 
second line-of -sight detection unit by driving a motor 
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so as to match the readout data, and then displays 
desired images on the first viewfinder and the second 
viewf inder . 
[0009] 

5 The binocular image sensing apparatus preferably- 

further comprises mode selection means for a 
stereoscopic mode and a panoramic mode, and when the 
stereoscopic mode is selected, the adjustment unit 
preferably stores, in the memory, first data of the 

10 baseline length which is detected in advance and 

matches each observer, and second data of a baseline 
length of the panoramic mode, when the stereoscopic 
mode is selected, reads out first data associated with 
a designated observer from the memory in accordance 

15 with designation of the observer, and when the 

panoramic mode is selected, reads out the second data 
and automatically adjusts the interval between the 
first line-of -sight detection unit and the second line- 
of~sight detection unit by driving a motor so as to 

2 0 match the readout first data and the readout second 
data . 
[0010] 

[Operation of the Invention] 
The display instruction unit instructs the image 
25 display unit to display viewpoint centers, and the 

image display unit displays the viewpoint centers on 
the first and second viewf inders. An observer observes 
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the viewpoint centers displayed on the first and second 
viewfinders with his two eyes through the first and 
second line-of -sight detection units. The first and 
second line-of -sight detection units detect the visual 
5 axis angles of the two eyes of the observer. The 

adjustment unit adjusts the interval between the first 
and second line-of -sight detection units until the 
visual axis angles of the two eyes that are detected by 
the first and second line-of -sight detection units 
10 become smaller than a threshold. 
[0011] 

Upon completion of adjusting the interval, the 
display instruction unit instructs the image display 
unit to display a stereoscopic image, and the first and 
15 second viewfinders display right and left images which 
form the stereoscopic image. The observer can 
appropriately observe the stereoscopic image at the 
interval adjusted for him. 
[0012] 

20 [Embodiments] 

Preferred embodiments of the present invention 
will be described below with reference to the 
accompanying drawings. Fig. 1 is a view showing the 
arrangement of a binocular image sensing apparatus 

25 according to an embodiment of the present invention. 
In Fig. 1, reference numeral 1 denotes a control unit 
which controls the whole operation; 2, a mode switch 
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for switching between the recording mode and the 
adjustment mode; 3, a push button for starting 
adjustment; 4, a recording start/stop switch; 5, a 
battery for supplying power to a camera; 6, an A/D 
5 converter for converting a battery voltage into a 

digital value in order to measure the battery voltage 
by a microcomputer or the like; 7, a nonvolatile memory 
such as an EE PROM for storing various parameters of the 
camera and the like; 8, an illumination means for 

10 illuminating an object; and 9R and 9L, driving motors 
for changing the convergence angle between a pair of 
image sensing units. The driving motor 9R drives the 
right image sensing unit, whereas the driving motor 9L 
drives the left image sensing unit. 

15 [0013] 

Reference numerals 10R and 10L denote right and 
left image sensing units, respectively, each of which 
comprises an image sensing lens, stop, shutter, image 
sensor, and the like and is equivalent to the image 

20 sensing unit of a movie camera or still camera. 

Reference numerals 11R and 11L denote exposure control 
units for controlling the exposures of the right and 
left image sensing units; 12R and 12L, autofocus 
control units for controlling the right and left image 

25 sensing units to optimal focuses; 13R and 13L, signal 
processing units for performing a color process, 
filtering process, and the like on the basis of signals 
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output from the image sensing units 10R and 10L; 14R 
and 14L, playback signal processing units for 
outputting images obtained by the image sensing units 
10R and 10L to EVFs (Electric ViewFinders) / and 15R and 
5 15L, display units such as EVFs for confirming images 
obtained by the image sensing units 10R and 10L. 
[0014] 

Reference numerals 16R and 16L denote line-of- 
sight detection units for detecting the lines of sight 

10 of the right and left eyes; and 17R and 17L, gazing 

point position processing units for determining gazing 
points from signals obtained by the right and left 
line~of -sight detection units, and generating gazing 
point signals used to superpose and display the gazing 

15 point positions on images on the EVFs. Reference 
numeral 2 0 denotes a motor for driving the image 
sensing units 10R and 10L in order to change the 
baseline length between the two image sensing units 10R 
and 10L. Reference numeral 21 denotes a storage unit 

20 for storing signals obtained by the image sensing units 
10R and 10L on a magnetic tape, magnetic disk, or the 
like. Reference numeral 22 denotes a motor for 
changing the interval between a pair (surrounded by a 
broken line) of the right EVF and line-of -sight 

25 detection unit and a pair of the left EVF and line-of- 
sight detection unit in synchronism with variable 
driving of the baseline length. 
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[0015] 

Figs. 2(A) and 2(B) are views for explaining the 
principle of the line-of -sight detection method. This 
method is described in detail in Japanese Patent Laid- 
5 Open No. 5-68188, and will be described briefly. In 
Fig. 2(A), reference numeral 300 denotes an eyeball; 
301, a cornea; and 303, an iris. A block 16 surrounded 
by a broken line corresponds to the line-of -sight 
detection unit 16R or 16L in Fig. 1. A block 17 

10 corresponds to the gazing point position processing 
unit 17R or 17L in Fig. 1. In the following 
description, the right and left arrangements are almost 
the same. Reference numeral 165 denotes a light source 
such as a light-emitting diode for projecting infrared 

15 light; 163, a projection lens; 162, a half -mirror; 164, 
a light-receiving lens; and 166, a photoelectric 
element . 
[0016] 

The projection lens 163 collimates infrared light 
20 emitted by the light source 165, and the half -mirror 
162 reflects parallel light to illuminate the cornea 
301 of the eyeball 300. A cornea-reflected image d 
formed from part of infrared light reflected by the 
surface of the cornea 3 01 passes through the half- 
25 mirror 162 and is condensed by the light-receiving lens 
164 to form an image again at a position Zdd on the 
photoelectric element 166. Light beams traveling from 
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ends a and b of the iris 303 form images at positions 
Zaa and Zbb on the photoelectric element 166 via the 
half -mirror 162 and light -receiving lens 164. 
[0017] 

5 Letting Za and Zb be the Z-coordinate points of 

the ends a and b on the iris 303, when the rotation 
angle 6 of the optical axis B of the eyeball 300 with 
respect to the optical axis A of the light-receiving 
lens 164 is small, the coordinate point Zc of the 
10 center position of the iris 303 is given by 

Zc - (Za + Zb) /2 ... (1) 

[0018] 

Letting Zd be the Z-coordinate point of the 
cornea-reflected image generation position d, and OC be 

15 the distance from the curvature center O of the cornea 
301 to the center C of the iris 303, as shown in Fig. 
2 (B) , the rotation angle 6b of the optical axis B of 
the eyeball satisfies 

OC x SIN ((9b) « Zc - Zd 

20 At this time, the Z-coordinate point Zd of the cornea- 
reflected image position d coincides with the Z- 
coordinate point Zd of the curvature center O of the 
cornea 3 01. Thus, the gazing point position processing 
unit 17 can obtain the rotation angle 6h of the optical 

25 axis B of the eyeball by detecting the positions Zaa 
and Zbb on the photoelectric element. 
[0019] 
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At this time, equation (1) is rewritten into 
(3 x OC x SIN(0b) - (Zaa + Zbb) /2 - Zdd ..-(2) 
where (3 is the magnification determined by the distance 
LI between the cornea-reflected image generation 
5 position d and the light -receiving lens 164 and the 
distance LO between the light-receiving lens 164 and 
the photoelectric element 166. In general, (3 is almost 
constant. The angle db is derived in the above way. 
In the following description, the visual axis angle is 
10 the rotation angle 8b of the optical axis B of the 

eyeball 300 with respect to the optical axis A of the 

light-receiving lens 164. 

[0020] 

An adjustment operation according to the 
15 embodiment in Fig. 1 will be explained with reference 

to the flowchart of Fig. 3. The switch 2 for switching 
between the recording mode and the adjustment mode is 
set to the adjustment mode. A user presses the push 
button 3 for starting adjustment. The convergence 
20 angle is initialized (step SI) . Since no convergence 
angle is adjusted, the motors 9R and 9L are driven to 
set the angle between the two image sensing units to a 
predetermined angle in advance. The motor 20 is driven 
to initialize the baseline length to a predetermined 
25 length (step S2) . For example, the baseline length 
change range is set in advance, and the motor 20 is 
driven to maximize the baseline length in an initial 



- 18 - 



JPA 7-23429 



state. In synchronism with this, the motor 20 is 
driven to make the interval L between the viewpoint 
centers (and the centers of the line-of -sight detection 
units) LP and RP of the left and right EVFs be equal to 
5 the interval between the optical centers of the image 
sensing units. As a result, the baseline length, i.e., 
the interval between the image sensing optical centers 
of the right and left image sensing units, the interval 
between the viewpoint centers of the right and left 

10 EVFs, and the interval between the centers of the line- 
of-sight detection units become almost equal to each 
other. The EVFs 15R and 15L display adjustment 
reference gazing points as shown in Fig. 4 (step S3) . 
The adjustment reference gazing points are references 

15 viewpoints when seeing two EVFs with two eyes in order 
to adjust the baseline length. An EVF observer adjusts 
the viewpoint of his left eye to LP and that of his 
right eye to RP during adjustment. To easily determine 
the viewpoint, the EVF does not display any image or 

20 the like which may distract the observer's attention, 
except for the adjustment reference gazing point. 
During an operation other than adjustment, the EVF 
displays an image and various types of information, 
like the EVF of a general video camera. 

25 [0021] 

After step S3, the baseline length is changed by 
a predetermined amount. Since the baseline length is 
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initialized to a maximum value in step 32 , it is 
changed shorter. The predetermined amount for changing 
the baseline length depends on the division counts of 
the maximum and minimum ranges. If fine adjustment is 
5 necessary, the predetermined amount is set small (step 
S4) . The line~of -sight detection units 16R and 16L 
measure visual axis angles representing angles at which 
the observer sees reference gazing points (step S5) . 
The baseline length and visual axis angles measured in 

10 step S5 are stored to create a table (step 36) . Step 

36 is a process routine executed several times till the 
end of adjustment. The purpose of this routine is to 
create a table which stores visual axis angles 
corresponding to respective baseline lengths from a 

15 maximum one to a minimum one. Every time step 36 is 
executed, storage areas are set to store data and 
create a table. 
[0022] 

It is checked whether each of the visual axis 
20 angles of the two eyes measured in step S5 is equal to 
or smaller than a predetermined value 8. If each of 
the visual axis angles of the two eyes is equal to or 
smaller than the predetermined value 6, it is 
determined that the observer sees the reference gazing 
25 points at proper angles at the current baseline length. 
The baseline length is stored as an adjustment baseline 
length, and the completion flag is set to store the 
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fact that the adjustment baseline length is obtained 
(step S8) . If each of the visual axis angles of the 
two eyes is larger than the predetermined value 8, it 
is determined whether the baseline length reaches a 
5 minimum value (step S9) . If the baseline length does 
reach the minimum value, the process returns to step 
S4 . If the baseline length reaches the minimum value 
in step S9, it is determined whether the completion 
flag is set (step S10) . 
10 [0023] 

If the completion flag is set in step S10, the 
baseline length is changed to the stored adjustment 
value (step Sll) , ending the adjustment. If no 
completion flag is set in step S10, the observer is 

15 warned that the adjustment fails (step S12) . The 

warning may be a sound or may be displayed on the EVF 
or the like. After the warning, no adjustment baseline 
length is attained in the adjustment routine, and thus 
the baseline length is changed to a specific value. 

20 The specific value may be the standard interval between 
human eyes. Alternatively, the baseline length may be 
set to a maximum value so as to facilitate an image 
process after image capturing (step S13) . 
[0024] 

25 The above description contains a storing 

operation to store data in the memory 7 (nonvolatile 
memory such as an EEPROM) in Fig. 1. Optical and 
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mechanical mechanisms are known for a general movie 
camera and still camera, and a detailed description 
thereof is omitted. Features unique to binocular image 
sensing will be additionally described. In most 
5 binocular image sensing cameras, the baseline length is 
fixed, or even if variable, manually set. The baseline 
length is not adjusted to the interval between the eyes 
of a recorder or an observer who observes an image 
later. Hence, the baseline length change range and 
10 lens aperture are not particularly limited. 
[0025] 

To the contrary, the present invention limits the 
variable baseline length range to a standard human 
value (about 4 cm to about 7 cm) in order to 

15 automatically adjust the baseline length. The aperture 
of at least one of lenses is set equal to or smaller 
than the minimum baseline length. With these settings, 
the present invention can prevent an increase in 
apparatus size, eliminate wasteful driving of the image 

2 0 sensing unit along the baseline length, and prevent 
wear of the apparatus and the like. 
[Other Embodiment] 

In the above embodiment, a photographer and a 
playback image observer are the same person. The 

25 following embodiment will describe a case in which the 
recorder and observer are different persons. In this 
case, baseline length data of the observer is stored in 
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advance. In recording, the baseline length range is 
adjusted to the baseline length adjustment value of the 
observer. For example, a memory 7 {EEPROM) stores data 
of persons. In recording, the data are read out to 
5 adjust and change the baseline length. 
[0026] 

As a method of selecting data of a specific 
person from data of persons, the EVF or an external 
display may display a candidate list to select target 
10 data with a selection cursor or the like. 

Alternatively, an interface capable of reading and 
writing data from and in a memory card may be adopted 
to replace the card for each person. 
[0027] 

15 As a method of storing data of an observer, the 

baseline length may be adjusted for each person and 
stored in an EEPROM or card, similar to the above 
embodiment . Alternatively, statistically 
representative data may be obtained by another means 

2 0 and stored. The baseline length may be adjusted not in 
recording but in playback by a signal process. In this 
case, a playback display process may change on the 
basis of pre-stored data of each observer. 
Alternatively, if the remaining battery amount is 

25 running short, convergence angle control and baseline 
length control may stop to adjust the baseline length 
similarly in playback. 
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[0028] 

When the binocular image sensing apparatus has 
the stereoscopic mode (3D mode) and the panoramic mode 
(mode in which not stereopsis but a wide frame is 
5 obtained by recording wide ranges with two cameras and 
synthesizing the frames in playback) , it is also 
possible to adjust the baseline length for each person 
in the 3D mode and adjust it to a predetermined value 
in the panoramic mode. The above example has been 

10 described in a case of practicing the present invention 
in a system which controls the convergence angles of 
two image sensing units. The convergence angle is also 
adjustable by a system in which one image sensing unit 
is fixed and only the other image sensing unit is 

15 driven. The image sensing unit may have an autofocus 
or fixed focus. 
[0029] 

[Effect of the Invention] 
As has been described above, the baseline length 

20 can be adjusted in accordance with the individual 

difference to store data of each person. In recording, 
the baseline length is adjusted to an optimal one for 
each person to capture an image. The present invention 
can easily implement a system capable of reducing the 

25 process load in playback and obtaining a natural 
panoramic view and stereopsis. By regulating the 
baseline length adjustment range and a corresponding 



- 24 - 



JPA 7-23429 



image sensing lens aperture on the basis of the 
interval between the eyes of a person, the present 
invention can provide a compact, light-weight apparatus 
with high durability. 
5 [Brief Description of the Drawings] 
[Fig. 1] 

Fig. 1 is a view showing the arrangement of a binocular 
image sensing apparatus according to an embodiment of 
the present invention. 
10 [Figs. 2 (A) and 2 (B) ] 

Figs. 2(A) and 2(B) are views for explaining a 
principle of detecting the visual axis angle by a line- 
of -sight detection unit. 
[Fig. 3] 

15 Fig. 3 is a flowchart for explaining a baseline length 
adjustment operation according to the embodiment in 
Fig. 1. 

[Fig. 4] 

Fig. 4 is a view showing a gazing point serving as an 
2 0 adjustment reference displayed on an EVF according to 
the embodiment in Fig. 1. 
[Fig. 5] 

Fig. 5 is a view showing the arrangement of a prior 
art . 

25 [Description of the Reference Numerals] 

1 control unit 

2 mode switch 
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3 push button switch 

4 recording start/stop switch 

5 battery 

6 A/D converter 
5 7 memory 

8 illumination means 

9R, 9L, 20, 22 motor 

10R, 10L image sensing unit 

11R, 11L exposure control unit (AE) 

10 12R, 12L autofocus control unit (AF) 

13R, 13L signal processing unit 

14R, 14L playback signal processing unit 

15R, 15L EVF 

16R, 16L line-of -sight detection unit 

15 17R, 17L gazing point position processing unit 

21 storage unit 

162 half-mirror 

163 projection lens 

164 light-receiving lens 
20 165 light source 

166 photoelectric element 
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FIG. 1 

(1) : CONTROL UNIT 

(2) : RIGHT EYE 

(3) : LEFT EYE 
5 5: BATTERY 

7: MEMORY 

8: ILLUMINATION MEANS 
10R, 10L: IMAGE SENSING UNIT 
13R, 13L: SIGNAL PROCESSING UNIT 
10 14R, 14L: PLAYBACK PROCESSING UNIT 

16R, 16L: LINE - OF - S IGHT DETECTION UNIT 

17R, 17L: GAZING POINT POSITION PROCESSING UNIT 

21: STORAGE UNIT 

15 FIG. 2(A) 

17: GAZING POINT POSITION PROCESSING UNIT 

162: HALF-MIRROR 

166: PHOTOELECTRIC ELEMENT 

3 00: EYEBALL 

20 301: CORNEA 

303: IRIS 

FIG. 3 
(1) : START 
25 (2) : END 

SI: INITIALIZE CONVERGENCE ANGLE 
S2: INITIALIZE BASELINE 
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S3 : DISPLAY REFERENCE GAZING POINT ON EVF 

S4: CHANGE BASELINE 

S5: MEASURE VISUAL AXIS 

S6: STORE BASELINE LENGTH AND VISUAL AXIS ANGLE, AND 
5 CREATE TABLE 

S7: VISUAL AXIS ANGLE < 51? 

SB: STORE ADJUSTMENT BASELINE LENGTH AND SET COMPLETION 
FLAG 

S9: MINIMUM BASELINE LENGTH? 
10 S10: COMPLETION FLAG SET? 

Sll: CHANGE BASELINE LENGTH TO ADJUSTMENT VALUE 
S12: GENERATE WARNING 

S13 : CHANGE BASELINE LENGTH TO SPECIFIC VALUE 



15 FIG. 4 

(1) : LEFT 

(2) : RIGHT 



FIG. 5 
2 0 51: CONTROL UNIT 

63R, 63L: SIGNAL PROCESSING UNIT 
71: STORAGE UNIT 
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